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STATISTICS  OF  NONLINEARLY  TRANSFORMED 
COHERENCE  ESTIMATES 


INTRODUCTION 


Previous  resiilis  on  i he  statistics  of  the  magnitude-squared-coherenee  (MSC) 
estimate  C  and  i he  magnitude-coherence  (MC)  estimate  £  have  required  sim¬ 
plification  of  Inpergcomeiric  functions  ,F„  sometimes  with  great  labor  (references 
1-4).  This  effort  has  been  required  because  of  the  paucity  of  asymptotic  results  for 
the  ,l\  function,  in  reference  4,  this  shortcoming  was  partially  alleviated  by 
deriving  asymptotic  results  for  the  MSC  estimate,  and  doing  curve-fitting  for  the 
MC  estimate,  thereby  obtaining  relatively  simple  relations  for  the  bias,  variance, 
and  mean-square  error  in  these  two  cases. 

However,  whenever  a  different  nonlinear  transformation  of  die  MSC  estimate  is 
considered,  the  analytical  effort  must  begin  anew  to  determine  the  fundamental 
behavior  of  the  oaiistics  such  as  moments.  For  example,  in  reference  5,  the  non¬ 
linear  transformation  arc  tanh  (f''  )  of  MSC  estimate  d  was  shown  to  yield  a  nearly- 
(iaussian  random  variable,  thereby  facilitating  calculation  of  confidence  limits  for 
eonere.’ce  detectors.  However,  the  mean  and  variance  of  the  nearly  Gaussian 
random  variable  were  deduced  by  a  time-consuming  trial-and-error  curve-fitting 
procedure. 

Here,  we  will  rectify  this  situation  by  deriving  simple  asymptotic  relations,  for 
large  N,  for  the  statistics  of  any  nonlinear  transformation  of  C,  where  N  is  the 
number  of  data  pieces  employed  in  the  estimation  of  coherence  (reference  6).  In  this 
fashion,  we  can  determine  the  fundamental  behavior  of  statistics  like  the  bias, 
variance,  and  mean-square  error  for  a  particular  distortion  of  £,  without  an  undue 
amount  of  labor.  Also,  we  can  deduce  new  nonlinear  transformations  with  desirable 
behavior. 
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ESTIMATION  OF  MAGNITUDE-SQUARED  COHERENCE 

The  complex  eoherenee  between  two  jointly-xtationary  random  processes  \(t)and 
v(l)  is  defined  as 

G  (f) 

Y  m  .  T - a - to  , 

y  K7f)  Vf)]  a. 

where  CiX4(f)  is  ihc  cross-spectral  density  at  frequency  f,  and  Gxv(f)  and  G„(f)  are 
the  auto-speeiral  densities.  The  MSC  is 


C(f)  =  lyxy(f) 


The  MSC  is  frequently  estimated  according  to  (reference  6) 


C(f)  = 


|g  (f) 

1  xy 


E  xn(n  v;(f) 

n=i 


oxx(«  E  lyol2  E  lyfll2 

77  n=l  n  n*l  n 


where  N  is  the  number  of  data  segments  employed,  and  X„(f),  Yn(f)  are  the 
(discrete)  Fourier  transforms  of  the  n-th  weighted  data  segments  of  x(t)  and  y(t). 

The  statistics  of  a  nonlinearly  transformed  version  g(£)  of  MSC  estimate  £  are  of 
interest  here.  We  drop  frequency  dependence  f  henceforth,  for  notational  sim¬ 
plicity;  thus  C  is  the  true  (unknown)  value  of  MSC  that  we  are  estimating. 
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AVERAGE  VALUE  OF  TRANSFORMED  COHERENCE  ESTIMATE 

The  probability  density  function  of  MSC  estimate  £  is  given  by  reference  1 ,  eg.  (2) 
et  seq.,  as 


P (x)  =  (N  -  1) 


(1  -  0(1  -  x)lN-2  / 

{1  +  Cx\ 

1  -  Cx  *N-1  \ 

J 

1  -  Cx) 

for  0  <_  x  <_  1,  0  <  C  <  1 


(4) 


where  Pv,  is  a  Legendre  polynomial.  If  ^ is  subjected  to  nonlinear  transformation 
g(C  ),  the  average  value  of  the  output  is 

A  =  E{g (C) }  =  f  dx  p(x)  g(x)  . 

•'0  (5) 


For  large  N,  probability  density  p(x)  is  peaked  about*  \=C;  see  reference  1, 
figures  la-1  h.  Accordingly,  the  major  contribution  to  (5)  will  come  from  this 
neighborhood,  so  we  expand  transformation  g  about  this  point: 


£  4r8(n,co 


n=0 


Cx  -  cj"  ,  t  £  8<n)  (O  v, 


n=0 


’  (6) 


where 

,  1 

\  =  J  dx  p (x)  (x  -  C)n 
0 

is  the  n-th  moment  of  estimate  £  about  true  value  C. 


(7) 


An  expression  for  general  moment  Ej£"'}  is  given  in  reference  4,  page  2,  along 
with  specific  simpler  results,  for  m  =  1  and  2,  in  terms  of  the  Gauss  hypergeometric 
function  ,F,.  In  appendix  A  here,  v,  and  v-,  are  developed  in  an  asymptotic  ex¬ 
pansion  through  order  N  :;  in  appendix  B,  the  dominant  behavior  of  vn  is  developed 
for  all  integer  n.  The  results  are 


..  U  -  C  r 


2C (1  -  C)‘ 
N2 


0(N-3) 


(H) 


v  _  2cq  -  cy 

2  "  N 


2(1  -  C)*  (1 


+  0(N"3j 


N 


(9) 


•For  C  =  I,  p(\)  =  ultercas  lor  (  I).  p(\)  (NO  )(I-\)N  Wo  exclude  these  atypical  cases  from 

consideration  here.  These  probability  density  functions  lor  (  =  t  and  f  -  0  are  sttlTicicntly  simple  that 
they  can  be  investigated  separately . 
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/  n.'  Cn/2(  1  -  C)n 


V  — 

n 


(n/2) 


!  Nn/2 


for  n  even 


n.'  C 


(1  -  C)n  [l  +  C  ♦  n(l  -  3C)1 


(¥■)' » 


n+1 

2 


for  n  odd 


as  N  »  ; 
C  >  0  . 

(10) 


In  particular,  it  is  seen  that  v,  and  v,  are  0(N  v,  and  v4  are  G(N  -),  and  vn  for  n>5 
is  0(N  ’)  or  smaller. 

C  ombining  these  results  in  (6),  we  obtain  for  the  average  value  of  the  device 
output: 

2 

A  =  g(C)  +  (1  ~  -C)  [g'  (C)  ♦  Cg"(C)] 

2 

+  ^-1--7C-)-  f 2Cg'  (C)  +  (1  -  6C  +  7C2)  g"(C) 

N 

+  2C(1  -  C)(l  -  20  g"(C)  +  |c2(l  -  C)2  g””(C)]  +  0(N’3!. 

(ID 

This  result  gives  the  fundamental  dependence  on  N,  C,  and  transformation  g. 
Through  0(N  1 ),  we  need  to  evaluate  the  nonlinear  function  and  its  first  two 
derivatives,  but  to  be  correct  to  O(N  -),  it  is  necessary  to  evaluate  up  through  the 
fourth  derivative  of  the  nonlinear  function. 

The  bias  at  the  output  of  the  nonlinear  device  is  defined  as 

B  =  E{g (C) }  -  g(C)  =  A  -  g(C)  , 


and  is  given  by  the  terms  after  g(C)  in  (11).  It  is  generally  of  ()(N  '):  this  will  be 
elaborated  on  later. 

A  particular  example  of  the  application  of  (II)  is  afforded  by  transformation 
g(x)  -  x.  Then  the  device  output  is  just  the  MSC  estimate,  and  (12)  yields  bias 


B 


(1  -  C)  2C (1  -  C)' 


N 


0(N‘3) 


N 


(13) 


in  agreement  with  reference  4,  eq.  (8). 


4 


TK  6445 


ALTERNATIVE  FORMS  FOR  AVERAGE  VALLE 
First-Order  Approximations 

Lot  us  retain  only  the  terms  throne  It  ()(N  'I  in  ( 1 1 )  and  12);  then 

2 

A  ~  g(C)  +  (1-  [g'  (C)  *  Cg"(C)]  as  N  -*•  “  , 


and 


B 


[&'  CC) 


Cg"  CO] 


as  N  +  “> 


(14) 


(15) 


Now  we  approximate  the  right-hand  side  ol  (14)  by  the  quantity 


>i  =  e(c  *  t1) 


(16) 


which  can  be  developed  as 

\  ~  gCO  +  g  (C)  as  N  -  - 


(17) 


and  we  choose  a(C)  so  that  (14)  and  (17)  match  as  N  becomes  large.  There  follows 
the  approximation  to  the  average. 


(18) 


The  bias  approximation  follows  from  (12)  and  (18)  as 


B 


1 


(19) 


Forms  (18)  and  (19)  turn  out  to  be  more  useful  than  (14)  and  (15).  respectively,  in 
some  cases.  For  the  MSC  estimate  itself,  g(x)  =  x,  and  the  results  yielded  by  (18)  and 
( 19)  are  identical  to  (14)  and  (15),  respectively. 

For  the  MC  estimate  £  ,  we  have 
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,  ,  1/2  t  1  -1/2  .  1  -3/2 

g(x)  =  x  g  (x)  =  y  x  ,  g  (x)  x 


Then  the  equations  above  \  ield 
A 


c1/2  .l1  -C>‘ 


4NC 


VT 


as  N  +  ® 


(20) 


(21) 


a  *  -^)1/2 


B  ~  — - 7T?  as  N  -*•  °°  , 


4NC 


1/2 


Bi  =  lc  +  14rI 


1/2 


-  C 


1/2 


(22) 


(23) 


(24) 


Whereas  (21)  and  (23)  blow  up  as  C'-*0.  (22)  and  (24)  remain  finite.  In  fact,  (24)  is 
preeisely  the  result  obtained  by  curve-fitting  in  reference  4,  page  (20).  eqs.  (39)  and 
(33),  (oO(N  '). 


This  is  a  fortuitous  situation  for  approximations  (22)  and  (24).  In  the  derivations 
above,  it  was  presumed  that  transformation  g(x)  could  be  well  approximated  in 
terms  of  a  few  derivatives  at  x  =  C  and  that  C>0.  These  conditions  are  obviously 
violated  for  MC  device  (20)  as  C-*0;  nevertheless,  forms  (22)  and  (24)  are  still 
reasonable  in  this  limit.  This  situation  will  arise  for  other  nonlinear  transformations 
considered  below.  The  basic  problem  is  that  (21)  is  not  a  uniform  asymptotic  ex¬ 
pansion  with  respect  to  C  (reference  7,  chapter  9);  it  holds  as  for  fixed  C>0. 


For  the  transformation  yielding  a  nearly  Gaussian  random  variable,  discussed  in 
the  Introduction  and  studied  in  reference  5,  we  have 

1/2,  r,..,  1 


g(x)  =  arc  tanh(x  '  ),  g'(x)  = 


2x1/2(l  -  x) 


g  (x)  = 


3x 


„  3/2,,  ,  2 

4x  (1  -  x) 


(25) 


Application  of  (14),  (15),  (18),  and  (19)  yields 


A  —  arc  tanhfC1^2)  +  1  *  as  N  +  « 

4NC  ' 


(26) 


f 

! 
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A 


1 


=  arc  tanh 


(27) 


B 


1  4- 

4,,'C 


_C 

1/2 


as  N  +  »> 


(28) 


B 


1 


arc  tanh 


arc  tanh(C) 


(29) 


Result  (27)  agrees  with  reference  5,  eqs.  (7)  and  (8).  which  was  obtained  only  after 
considerable  trial  and  error  and  eurve-litting.  Again,  the  approximations  (27)  and 
(29)  are  better  behaved  than  their  progenitors  (26)  and  (28)^  which  blow  up  as  C-*0. 
As  above.  (26)  is  not  a  uniform  asymptotic  expansion  w  ith  respect  to  C. 

Finally,  let  us  inquire  into  what  nonlinear  transformation  would  yield  zero  bias, 
to  ()(N  ').  Equation  (15)  indicates  that  the  only  such  device  must  satisfy 

(Cg' (C) }  =  0  .  (30) 

That  is,  the  logarithmic  transformation 


g(x)  =  a  ln(x)  +  b 


(31) 


has  zero  bias,  for  any  constants  a  and  b,  to  0(N  '). 


Second-Order  Approximations 

We  now  retain  terms  through  0(N  :)  in  the  average  (II)  and  represent  it  by 
shorthand  notation: 


A  -  8(0  -  igl  .  m 
N  N 


as  N  +  » 


(32) 


We  now  want  to  fit  this  asymptotic  expansion  by  the  approximation 


to  Q(N  ~).  Accordingly  we  develop  (33)  as 


(33) 


A^  -  g(C)  +  g  (C) 


/a(C) 
V  N 


b(C)\ 
N2  } 


2  8 


(C) 


a2(C) 


as  N 


(34) 
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Comparison  of  (32)  and  (34)  yields 


a(C) 


a(C) 
&’  (C) 


,  b(C) 


6(C)  _  g"(C)  q2 (C) 
g'(C)  2[g'(C)]3 


where  from  (II),  we  already  know 

a(C)  =  (1  -  C)2  [g'  (C)  +  Cg"  (C)  ]  , 

6(C)  =  (1  -  C)2  [2Cg'(C)  +  (1  -  6C  +  7C2)  g”(C) 

+  2C  (1  -  C)  (1  -  2C)  g"'(C)  ♦  jC2(l  -  C)2  AC)] 


(35) 


(36) 


Equation  (33),  together  with  (35)  and  (36).  gives  the  seeond-order  approximation  to 
the  average  value.  The  result  for  a(C  )  m  (35)  is  identieal  to  that  obtained  earlier  in 
(18):  that  for  b(C)  is  quite  involved  and  requires  a  speeifie  transformation  for 
simplifieation. 

The  results  for  bias  are  now  obtained  by  combining  (12)  and  (32). 


R  a(C) 

B~  ^r 


6(0 


as  N 


(37) 


and  by  combining  (12)  and  (33), 


B 


1 


^  a(C)  b(C)\ 
N  N2  ) 


-  g(C) 


(38) 


Thus  our  general  results  to  Q(N  -)  are  given  by  (32),  (33),  (37),  and  (38),  where  the 
various  parameters  are  given  in  (35)  and  (36).  Now  we  apply  these  results  to  specific 
examples. 

For  the  \1SC  estimate  itself. 

g(x)  =  x  ,  g  (x)  =  1,  g"  (x)  =  g’"(x)  =  g"'tx)  =  0  . 


and  there  follows 
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This  last  rdaiion  lias  a  I  reads  been  noted  in  (13). 
l  or  i lie  NIC  estimate,  we  have 

g(x)  =  x1/2,  g'  (x)  =  j  x'1^,  g"(x)  =-j  x'3/2 


g-(*)  -  |x-5/2,r(x)  =-^|x-7/2  . 
TTpiation  (36)  yields 

(1  -  C)2  „  (1  -  C)2  (1  +  3C) 2 

8 - ^372  - 

and  (35)  yields 


(41) 


(42) 


a  = 


-  n  -  C)‘ 


b  = 


(1  -  C)2  (1  +  2C  +  5C2) 
8C 


(43) 


Then  (32)  and  (33)  yield,  for  the  results  on  the  average  value  for  the  M(  estimate. 


r1/2  +  C1  -  C)  +  (1 


C)2  (1  ♦  3C) 2 
32N2C3/2 


as  N 


(44| 


■('* 


(1  -  C)‘ 
2N 


(i  -  cr  a 


2C 


+  5C2) 


8N  C 


r 


(45) 


while  (37)  and  (38)  give  the  corresponding  results  on  bias;  namely,  subtract  C 
from  each  of  the  expressions  in  (44)  and  (45). 

We  now  observe  the  disconcerting  result  that  inclusion  of  the  0(N  :)  term  in 
approximation  (45)  blows  up  at  C  =  0,  whereas  the  0(N  ')  term  does  not.  This 
suggests  that,  for  small  C,  whereas  approximation  A,  in  (16)  was  well-suited  to  the 
available  information  to  0(N-'  ),  there  is  a  more  suitable  approximation  than  A:  in 
(33)  when  0(N  :)  information  is  available  on  the  average  value;  this  possibility  is 
taken  up  in  appendix  C.  Basically,  the  fact  that  (44)  is  not  a  uniform  asymptotic 
expansion,  with  respect  to  C,  is  causing  this  singularity  at  C  =0.  However,  (44)  and 
(45)  yield  very  good  approximations  for  large  N  and  C>0. 


For  the  arc  tanh  (x  )  transformation,  we  augment  (25)  with  the  two  additional 
terms 

2 

Jill,  O^OOX  -  COX  + 


iii,  „  3  -  lOx  +  15x“  mi,  3(35x3  -  35x2  +  21x  -  5) 

g  Cx)  =  —572 - T~  -  g  W  =  - 772 - ; - 

8xb/^(l  -  x)  16x//Z(l  -  x) 


(46) 
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1  lion  from  (36), 


1  +  C  „  (1  +  C)  (1  +  6C  +  C  ) 

° '  4ci/2  •  n?75 


and  from  (35) 


_  _  1  -  C2  t  _  (1  -  C2)  (1  +  2C  -  C2) 
a - 2  *  b - 8C - 


The  average  output  can  now  be  obtained  from  (32)  and  (33)  in  the  forme 


_  ,  ,„l/2,  1  +  C  (1  +  C)  (1  +  6C  +  C ) 

A  ~  arc  tanh  (C  )  +  - r-p?  +  - - - -  as  N  +  ®  , 

4NC1/^  32N  (49) 


A,  -arc  t,nh((c  ,1 4/ ♦  »  ~  ^  j1  *  2C  ~  & 
2  \\  2N  8N2C  * 


r) 


Since  are  tanh  (x ‘  )  ~  x  as  x-*0,  the  same  behavior  regarding  the  blow  up  at  C  =  0 
of  the  0(N  -)  term  is  expected  and  present,  just  as  for  the  MC  estimate  relations  in 
(44)  and  (45).  The  bias  of  the  are  tanh  (x  )  transformation  is  obtained  by  sub¬ 
tracting  arc  tanh  (C  )  from  both  forms  in  (49)  and  (50).  A  modification  of  ap¬ 
proximation  (50),  better  suited  to  small  C,  is  developed  in  appendix  C. 

For  the  logarithmic  transformation  of  the  MSC  estimate,  we  have 
g(x)  =  ln(x),  g'  (x)  =  x*1,  g"(x)  =  -x"2, 

IM/  x  a  -3  Ml|/  x  /  “4 

g  00  =  2x  ,g  (x)  =  -6x  .  51 

Equation  (36)  yields  the  surprising  result 


a  =  0  ,  8  =  0, 


for  which  (35)  immediately  gives 


a  =  0  ,  b  =  0 


Thus  both  (32)  and  (33)  yield  for  the  average  value  of  the  device  output 


A  -  A2  =  ln(C)  +  0(N'  )  . 


Thus  the  unbiased  character  of  the  logarithmic  distortion  holds  to  at  least  0(N  -), 
not  just  0(N  *)  as  claimed  originally  in  (30)  and  (3 1 ).  This  behavior  in  (54)  holds  of 
course  for  C>0,  as  noted  earlier. 
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In  appendix  D,  ihe  average  value  of  the  ln(\)  transformation  is  derived  exaetly;  it 
is  given  hy 


(55) 

By  completing  the  summation  to  infinity,  and  then  subtracting  this  added  quantity, 
we  can  write  (55)  as 

c°  n 

A  =  ln(C)  +  E  -  for  C  >  0  , 

n=N  n  (56) 


N-l 

=  -L 

n=l 


(i  -  cy 


for  all  C  and  N 


which  has  no  approximations  whatsoever.  The  summation  in  (56)  is  the  bias  and  can 
be  upper-bounded  by 


B  < 


Cl  -  C)1 
NC 


exp(N  ln(l  -  C) ) 
NC 


for  C  >  0 


(57) 


Thus  the  decay  of  the  bias  is  exponential  in  N  for  fixed  OO.  This  explains  why  the 
coefficients  of  N*1  and  N~2  were  zero  in  (53);  in  fact,  all  coefficients  of  N  k  would  be 
zero  for  k^l. 

We  should  also  observe  (reference  8,  eqs.  6.3.2  and  6.3.18)  that  average 


A 


In  (C)  +  for  C  >  0 

-y  -  ln(N)  +  ~  for  C  =  0 

2N 


as  N  +  » 


(58) 


Thus  as  the  number  of  pieces,  N,  used  in  the  MSC  estimate  increases,  the  average  A 
saturates  at  ln(C)  for  C#(),  but  gets  arbitrarily  negative  for  C  =  0.  This  is  due  to  the 
singularity  of  the  transformation  ln(\)  at  \  =  0. 

The  last  nonlinear  transformation  we  consider  is  the  v-th  law  device: 

g(x)  =  xv,  =  (v  +  1  -  n)  xv_n  . 

(59A) 


Substitution  in  (35)  and  (36)  yields,  after  simplification, 

2.  .2  v-1 

a  =  v  (1  -  C)  C  , 

8  =  \  v^(l  -  C)2  CV"2  [1  -  v  ♦  (1  +  v)  C)2  , 


and 
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a  =  v(l  -  C)2  , 

2 

b  =  y(12~  [Cl  +  Q2  -  v(l  -  C)  (1  ♦  3C)]  ,  (60) 

respectively.  The  average  output  of  the  v-th  law  device  is  then  available  upon 
substitution  of  (60)  in  (32)  or  (33).  These  results  reduce  to  (40)  for  v=  1,  and  to  (42) 
through  (45)  for  v  =  1/2.  It  can  be  seen  from  (60)  that  the  only  case  where  b  does  not 
tend  to  infinity,  as  C  tends  to  zero,  is  for  v  =  1,  the  MSC  estimate.  All  other  cases  do 
not  yield  a  uniform  asymptotic  expansion  in  powers  of  N1,  with  respect  to  C.  A 
modification  of  (60)  to  circumvent  the  singularity  at  C  =  0  is  presented  in  appendix 
C. 
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VARIANCE  OF  TRANSFORMED  COHERENCE  ESTIMATE 

In  order  to  determine  the  variance  of  the  transformed  coherence  estimate,  we 
need  to  be  able  to  evaluate,  in  addition  to  (5),  the  average 


1  1 

Q  =  E{g2 (C) }  =  f  dx  p(x)  g2(x)  =  f  dx  p(x)  q(x)  , 
*/0  J  0 


(61) 


where  we  have  defined 


qOO  =  g  lx)  . 


(62) 


But  now  we  can  use  average  output  (1 1)  on  (61),  with  a  re-identification  of  g  in  (II) 
as  q  here.  So  we  need  the  quantities  (using  an  obvious  shorthand  notation) 

9  /  I  II  II  -  I  I  III  _  III  /-I  I* 

q  =  g2  ,  q  =  2gg  ,  q  =  2gg  +  2g  g  ,  q  =  2gg  +  6g  g  , 


HU  o  '  III  ,  t 

=  2gg  +  8g  g  +  6g  g 


(63) 


where  all  these  functions  are  evaluated  at  C.  There  follows  from  (11), 

z  , . .  .  ri  n' 2 

Q  =  g  + 


-  -  ^  2(1  “  C)  r  '  C  n'  1  T  fl  -  C)  r  ' 

=  "  -  [gg  +  Cgg  +  Cg  g  ]  +  -i - [4Cgg 


N 


N 
•  # 


2(1  -  6C  ♦  7C^)  (gg"  +  g'g') 

♦  4C(1  -  C)  (1  -  2C)  (gg"'+  3g'g") 


+  C2(l  -  C)2  (gg""  +  4g'  g"'  +  3g"g")]  +  0(N  3) 


(64) 


The  variance  of  the  device  output  is  then 


V  =  Q  -  A 


(65) 


Substitution  of  (1 1)  (as  is)  and  (64)  in  (65)  and  cancellation  of  a  number  of  similar 
terms  yield  the  desired  result  for  the  variance  of  the  device  output : 

v  =  2C(1-  CJ-  g  g'  ♦  (1-~^)2  [g  %  (1  -  IOC  +  13C2) 

iN 

♦  g'g”2C(l  -  C)  (5  -  11C)  +  g"g"2C2(l  -  C)2 


+  g'g"  4C  (1  -  C)  ]  +  0(N~  ) 


(66) 


Here  g  ’  =  g  '(C),  g  "  =  g  "(C),  g '"  =  g  "  '(C).  We  observe,  that  to  OfN1).  only  the 
first  derivative,  g '(C),  is  required  for  the  variance;  recall  that  to  0(N  '),  the 
average,  (II),  required  g  '  '(C)  in  addition.  Also  g  "  ’  '(C)  does  not  enter  (66),  at  least 
through  0(N  2). 
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The  lirsi  example  we  apply  (66)  to  is  the  MSC  estimate,  g(x)  =  x.  There  follows 
immediately 

v  =  2C t1  -  C)2  +  a  -  C)2  (1  -  IOC  +  13C2)|  0(n-3} 

N  N2  (67) 

This  result  agrees  w  ith  reference  4,  eq.  9,  to  0(N  2)  when  the  latter  is  expanded  in 
powers  of  N  '. 

Next  consider  the  MC  estimate  as  given  in  (41 ).  Employment  in  (66)  results  in 

V  =  (1  omC'"  -  ■  [1  +  2C  -  UC2]  +  0(N'3)  . 

8N  C  (68) 


The  first  term  in  (68)  agrees  with  that  in  reference  4,  eq.  (33),  to  0(N-').  The  second 
terms  do  not  agree,  due  mainly  to  the  C'1  dependence  in  (68);  that  is,  once  again, 
(68)  is  not  a  uniform  asymptotic  expansion  with  respect  to  C.  A  modification  to  the 
singular  contribution  is  considered  in  appendix  E;  the  result  is  given  by  (E-2): 


V  = 


d  -  cr  (l  -  c)  (i  -  3C) 


2N 


2N 


(69) 


This  modification  for  the  variance  of  the  MC  estimate  agrees  precisely  with  the 
terms  through  0(N2)  of  reference  4,  eq.  (33),  when  the  latter  is  developed  in  a 
power  series  in  N*1. 

The  pertinent  equations  for  the  arc  tanh  (x  )  transformation  are  presented  in  (25) 
and  (46).  Their  use  in  (66)  for  the  variance  yields 


V  = 


1 

2N 


LjiJ£*£  ♦  ocn-3) 

8N  C 


(70) 


Thai  is,  to  0(N  ■),  the  variance  of  the  arc  tanh  (x ’  )  output  is  independent  of  the 
true  value,  C,  of  the  MSC.  This  result  has  been  noted  and  utilized  before;  see 
reference  9  and  reference  5,  eq.  (9).  Furthermore,  from  (66),  it  may  be  seen  that  the 
only  device  with  variance  independent  of  C,  to  O(N  '),  is  in  fact  q,  arc  tanh  (x  )  + 
q„  where  q,  and  q,  are  constants. 

A  modification  to  (70)  is  derived  in  (E-3)  and  (E-4),  namely, 


(71) 


That  is,  the  modification  indicates  a  variance  independent  of  the  true  value  C  of  the 
MSC,  through  0(N  :). 


For  the  logarithmic  transformation,  we  substitute  (5 1 )  in  (66)  and  obtain 
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V  = 


2d  -  cr 

NC 


(i  -  cr  (i  ♦  o' 

2  2 
NC 


+  0(N  ) 


(72) 


Here,  even  ihe  0(N  ')  lerm  lends  to  infinity  as  C~*0;  this  is  due  to  the  singularity  of 
the  ln(.x)  transformation  at  x  =  0.  Evaluation  of  the  mean  square  value  and  variance 
of  the  device  output  is  conducted  in  appendix  D;  in  particular,  for  the  anomalous 
situation  at  C  =  0  in  (72),  we  find  the  exact  result  (D- 17): 


N-l  , 

V  =  Yj  ~T  for  C  =  0  . 

k=l  k 


Asymptotically  this  behaves  as  (D- 1 8): 

2  l  1 

V  =  -t~  -  rj-  -  — *  0(N~3)  for  C  =  0 
6  N  2N2 


(73) 


(74) 


Thus,  whereas  the  variance  of  the  logarithmic  device  output  tends  to  zero  as  N-*°°  if 
00,  according  to  (72),  the  variance  stabilizes  at  rt2/6  as  lor  C  =  0.  This 

means  that  increasing  the  number  of  pieces,  N,  employed  in  the  MSC  estimate  will 
not  help  in  reducing  the  fluctuations  at  the  device  output  if  C  =  0.  However,  it 
should  be  recalled  from  (58)  that  the  average  device  output  becomes  arbitrarily  large 
negatively  in  the  case  of  C  =0;  thus  the  ratio  of  standard  deviation  to  average  value 
does  decrease  to  zero  as  for  C  =  0  as  well  as  for  C>0.  This  particular 

behavior  of'the  ln(x)  transformation  is  due  to  the  logarithmic  singularity  at  x  =  0. 

For  the  v-th  law  device,  we  employ  (59)  in  (66)  and  find 


V  = 


2v2(1  -  C)2  C2V~1 
N 


2,  ,2  _2v-2  _ 

♦  v  ■  '  y  -  [(1  +  cr  -6v(i  +  C)  (l  -  c) 

N 


♦  6v2(1  -  C)2]  +  0(N-3)  . 


(75) 


For  v=  1,  this  reduces  to  (67),  while  for  v=  '/i,  it  becomes  (68).  A  modification  to 
the  singular  component  of  (75)  at  C  =0  (for  v  <  1)  is  obtained  in  (E-6): 


2(1  -  3v(l  -  C))l 

N  J  '  (76) 

For  v=  l/:,  this  reduces  to  (69).  The  variance  approximation  (76)  is  not  singular  at 
C  =0,  provided  that  v  >  '/:. 


V  = 


2v2(1  -  C)2  C2v' 
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MEAN  SQUARE  ERROR  OF 
TRANSFORMED  COHERENCE  ESTIMATE 


The  desired  output  of  the  nonlinear  transformation  is  the  non-random  constant 
g(C).  However,  the  actual  output  is  g(£ ).  We  therefore  form  an  average  squared 
error  as 


S  5  E{[g(C)  -  g(C)]2}  . 


(77) 


But  this  can  be  expressed  in  terms  of  previously  evaluated  quantities  according  to 
S  =  E{ [g (C)  -  E(g (C) )  ♦  E{g(C)  }  -  g(C)]2} 


=  E{[g(C)  -  E{g (C)  } ] 2 )  ♦  (E{g(C)  }  -  g(C)l2  =  V  +  B2  , 

(78) 

where  the  cross-product  term  averages  to  zero.  When  we  use  the  results  of  (1 1),  (12), 
and  (66),  (78)  yields  the  general  result  for  the  mean  square  error: 


S  = 


-  2C(1  -  C) 


(1  -  C)‘ 


+  ^  [2gg  (1  -  6C  ♦  7C  ) 


♦  12gg  C(1  -  C)  (1  -  2C)  +  3g  g  C  (1  -  C)‘ 
♦  4gg"c2(l  -  C)2}  ♦  0(N-3)  . 


(79) 


For  the  MSC  estimate  itself,  g(x)  =  x,  and  (79)  yields 


„  .  2C(1  -  C)2  2(1  -  C)2  (1  -  6C  ♦  7C2)  . 

b - ^ -  +  - = -  +  0(N  ) 

N 


(80) 


in  agreement  with  reference  4,  eq.  (12),  when  the  latter  is  expanded  in  powers  of 
N 


For  the  MC  estimate,  g(x)  =  x '  -  ,  and  there  follows 


S  = 


(i  -  cy  (i  -  era  +  6 c 

2N  '  16N2C 


.  0(N-3) 


For  the  arc  tanh  (x  )  device,  use  of  (25)  and  (46)  in  (79)  leads  to 


(81) 
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1  1  -  14C  +  C  „,„..3^ 

S  =  2N - 2 -  +  °(N  )  • 

2N  16N2C  (82) 

To  0(N  '),  the  mean  square  error  is  independent  of  the  true  value,  C,  of  the  MSC. 

For  the  logarithmic  transformation,  (79)  gives 


,  _  2(1  -  C)2  .  (1  -  C)2  (1  +  C)2  . 
-  ^ - ~ -  + 


NC 


2  2 
N  C 


0(N~  )  . 


(83) 


This  equals  variance  (72),  of  course,  since  the  bias  is  zero  to  all  orders  N  k,  as  shown 
in  (57). 

Finally,  the  v-th  law  device g(x)  =  xv  yields,  with  the  help  of  (79), 


2v2(1  -  C)2  C2v_1  ,  v2(l  -  C)2  C2v'2 
N  n2 


[(1  +  C)2  -  6v  (1  +  C)  (1  -  C)  +  7v2(1  -  C)2]  +  0(N-3)  . 


(84) 


For  v=  1,  this  specializes  to  (80),  while  for  v=  '/;,  it  becomes  (81). 
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DISCUSSION  AND  SUMMARY 

Asymptotic  expressions  for  the  average  value,  bias,  variance,  and  mean  square 
error  of  the  output  of  a  nonlinear  transformation  have  been  derived,  to  0(N  2). 
Extensions  to  higher  moments  of  the  device  output  are  easily  accomplished  by 
interpreting  q  in  (61)  as  the  appropriate  moment  of  g,  as  was  done  in  (62)  for  the 
second  moment.  For  example,  we  could  evaluate  the  third  cumulant  of  g(^  )  in  this 
fashion. 

The  modifications  adopted  here  to  attempt  to  alleviate  the  singular  behavior  at 
C'  =  0  of  (he  terms  of  0(N‘2),  for  the  are  tanh  (x1)  and  v-th  law  devices,  are 
recognized  to  be  incorrect.  The  reason  for  the  seemingly  anomalous  behavior  is  that 
the  results  here  are  not  uniform  asymptotic  expansions  with  respect  to  C.  The 
proper  wav  to  handle  these  eases  is  to  derive  the  appropriate  uniform  asymptotic 
expansions.  However,  this  would  likely  be  a  time-consuming  and  tedious  task;  the 
methods  of  reference  7,  chapter  9,  would  be  very  relevant  in  this  regard. 

It  is  now  a  simple  matter  to  evaluate  the  statistics  of  any  additional  candidates  for 
MSC  estimate  transformation,  such  as  -In  (1-x),  ~(l-x)\  -are  tanh  {( 1  -x)  ),  for 
example.  These  devices  are  not  necessarily  suggested  for  actual  use,  but  rather  are 
obvious  modifications  of  the  ones  considered  here;  they  have  been  chosen  to  be 
monotonically  increasing  over  (0,  I ). 


1 
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Appendix  A 

Asymptotic  Development  of  First  Two  Moments 

From  (7),  the  n-th  moment  of  (^about  C  is 

1 

vn  =  j  dx  p(x) (x  -  C)n  . 

0 

Of  course  v(,  =  I.andv!  =  p,  -  C,  where  moment 


Jn  =  /  dx  ^ 


0 

We  now  employ  reference  4,  eq.  (5)  to  obtain 


(A- 1 ) 


(A-2) 


vi  =  ‘C  +  KF  +  j^FTT  C  p(1*  1;  N  +  2;  c) 


(A-3) 


At  this  point,  we  expand  all  the  terms  in  (A-3)  to  0(N -);  there  follows 

”i '  -c  *  s  *  (l  -  sX1  -  ir  rr) c  (‘  *  rrr  *  Tr-w-  ») 


+  0(N  ) 


=  .  o(N-5) 

N 


(A -4) 


after  simplification.  Also  p,  =  C  +  V!  gives  p,  to  0(N~2). 
For  n  =  2,  (A-l)  and  (A-2)  yield 

2 

v2  =  u2  ~  2Cu^  +  C 


(A-5) 


An  expression  for  p2  is  given  in  reference  4,  eq.  (6);  we  develop  it  in  like  fashion  to 
(A-4): 


U2  =  -N  +  2N 


-  2  ‘  N  *  ('  -  li)  (*  -  H  *  h2  -  n3  *  „<) 


'(N2  -  NC  +  2C)  F  +  0(N'3)  , 


(A-6) 


A-l 
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where 


F  =  1  + 


2C 


N  +  2  (N  +  2)  (N  +  3) 


.  _ 6cf _  24C4  .  -5. 

(N  +  2)  (N  +  3)  (N  +  4)  +  4  +  UlN  > 

N 


(A-7) 


We  must  keep  terms  to  0(N4)  to  counter  the  N2  terms  in  (A-6).  Substitution  of(A-7) 
in  (A-6),  expansion  of  all  the  products,  and  retention  of  the  highest  orders  yields, 
after  considerable  manipulation, 


„2  .  4C  (1  -  C)2  .  2(1  -  C) 2 (1 
N  ~2~ 


ZL-  ♦  0(N-3) 


N 


(A-8) 


Finally,  substitution  of  (A-8)  and  (A-4)  in  (A-5)  yields 


..  _  2C  ( 1  -  C)2  2(1  -  C)2  (1  -  6C  +  7C2)  -3 

- - -  +  - 5 -  +  °(N  )  ■  (A-9) 

N 


N 


Although  continuation  of  the  procedure  above  to  higher  moments  such  as  and 
(and  thence  v3  and  v4)  is  possible,  it  is  extremely  tedious  and  error  prone.  A  useful 
asymptotic  development  of  (A-l)  is  proferred  in  appendix  B. 


A-2 
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Appendix  B 

Asymptotic  Development  of  n-th  Moment 


The  n-th  moment  of  interest  is  given  by  (7), 

1 

vn  =  /  dx  P(x)(x  -  C)n  *  (B-i > 

0 

while  p(\)  is  given  by  (4).  For  large  N,  the  probability  density  p(x)  peaks  in  the 
neighborhood  of  x  =  C.  To  see  this,  we  use  the  asymptotic  expansion  of  the 
Legendre  polynomial  given  in  reference  10,  page  194,  eq.  8.21 .1 : 


p„w 


(y  -  C,2  -  n1/2) 


m+1/2 


as  m 


(2irm)1//2(y2 


1) 


1/4 


for  y  >  1 


(B-2) 


We  now  identify  m  =  N-l  and  y  =  (1  +  Cx)/(1-Cx);  then  (B-2)  and  (4)  yield 


P(x) 


(N  -  1)1/2  (1  -  C)N  (1  -  x) 

2,1/2  (Cx)1/4  (l  -^)2N-1 


N-2 


as  N  +  “ 


for  Cx  >  0  . 

(B-3) 


The  function  (l-x)/(l-  V^fx)2  peaks  at  x  =  C;  raising  it  to  a  power  sharpens  this 
peak.  The  exact  location  of  this  peak  to  0(N->)  is  considered  in  appendix  F.  Sub¬ 
stitution  of  (B-3)  in  (B-l)  yields 


v 

n 


N1/2(l 


C)‘ 


2,1'2  C1/4 


j  dx(x 


n  1  -  \[Cx _  1  -  x 

X1/4(l  -  X)2  _(l  -  x/cx)2 


as  N  -*•  00  , 
for  C  >  0  , 


(B-4) 


where  the  integration  can  be  confined  to  the  neighborhood  of  the  peak  of  the 
bracketed  function  at  x  =  C. 


The  general  problem  is  now  to  determine  the  asymptotic  behavior  of  the  integral 
I  =  / dx(x  -  C)n  f (x)  [<Kx)]N 

as  N-*o°,  where  the  integration  is  confined  to  the  neighborhood  of  the  peak  of  <f>(x) 
at  x  =  C.  This  problem  is  undertaken  later  in  this  appendix;  here  we  shall  merely 
make  the  identifications  and  evaluate  the  required  parameters.  We  use  only  the 
dominant  term  in  that  asymptotic  expansion: 


B-l 
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1  -  \[Cx  ,  ,  1  -  x 

1/4  2’  4>(x)-  _  - 

x 7  (i  -  xr  (i 


h  -  f  -  1  h  -  e  7C  -  1 

°  °  C1/4(l  -  C)  ’  1  1  4C5/4(1  -  C)2 


*o  =  T-rc  .  1>i  *  0 


-1  ,  3(1  -  3C) 

3  »  4*3  ~  2  4 


2C (1  -  C) 


4C(1  -  C) 


4C  (1  -  C) 


2  *  P3  "  „„2 


1  -  3C 


8C  (1  -  C)' 


0X  =  ( y  +  l)  4C(1  -  O2  for  n  odd. 


The  result  for  integral  I  in  (B-5)  then  becomes 


<¥■)[ 


1— 

4C (1  -  C)2]  2 


for  n  even 


(1  -  O  N  C1/4(l  -  C) 


r(y  +  l)  [4c  (1  -  c)2]2  [1  +  C  +  n(l  -  3C)] 


for  n  odd 


(1  -  C)N  N2  4C5/4  (1  -  O2 


as  N  +  «>  , 


for  C  >  0 


Substitution  in  (B-4)  and  simplification  lead  to 


n!  Cn/2  (1  -  C)n 
(n/2) !  Nn/2 


for  n  even 


n!  C  2  (1  -  C)n  [l  C  ->■  n(l  -  3C )] 


for  n  odd 


as  N  00 
for  C  >  0 
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This  is  the  desired  general  result;  particular  values  are 

,  ..  (1  -  C)2  2C(1  -  C)2 

Vo  ~  V1 - N -  ’  V2 - N - 


12C(1  -  C)3(l  -  2C)  12C2(1  -  C)4 

2  »  V4 - 2 - 

4  N 


60C2(1  -  C)5(3  -  7 C)  120C3fl  -  C)6 

7  ,v‘ - 7 - 


as  N  +  “  ,  for  C  >  0. 


Asymptotic  Development  of  I 

The  integral  of  irterest  is  given  in  (B-5),  where  f(C)  #  0  and  where  n  is  an  integer. 
<t>(x)  has  a  maximum  at  the  point  C  which  is  interior  to  the  range  of  integration.  We 
shall  use  and  extend  the  procedure  given  in  reference  1 1,  pages  272-274,  to  develop 
the  asymptotic  expansion.  We  also  limit  the  derivation  here  to  the  case  of  n  even; 
the  extension  to  n  odd  is  presented  without  derivation. 

Let  A  =  x  -  C  and 

<p(x)  ~  <P0  +  i  <f>2A2  +  JJ-  +  -y  <J>4A4  as  A  +  0 


where 


Also  let 


=  <D0[l  ♦  P2  A2  *  p3A3  +  P4  A4]  , 


_  (m) f 

d>„  =  d>  (C)  ,  p  =  — j—7 
m  m  m .  G 


f(x)  f  +  f  A  +  i  f  A2  as  A  -*■  0 
o  1  2:2 


(B-10) 


(B-l  1 ) 


where 


=  b  +  b  A  +  b-A 
o  1  2 


f  =  (C),  b  =  — y-  . 

m  m  m 


(B-12) 


(B-13) 


Substitution  in  (B-5)  yields 


I 

L 
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2  3  4 

+  P2A  +  p3A  +  p4A 


I  ~  /  dA  An^bQ  +  bj  A  +  b.,  A2)  <^'  exp^N  ln(l 
~  4>g  f  dA  An^bQ  +  bxA  +  b2A2^  exp^N^A2  +  p3A3  +  p4A4  -  p2A 4/2^J 

=  4>q  /  dA  An  (bQ  +  bjA  +  t>2A2)  exp  ^-N  |  p2 | A2) 

.  exp^Np3A3)  exp^p4  -  p2/2^  , 


where  we  utilized  the  fact  that  p  2  <  0  since  $(x)  peaks  at  x  =  C. 


(B  14) 


Now  let  t  =  A/N!  in  (B-14)  and  define  q  =  (n+1  )/2;  then 


-  ^  J dt  ex',('t°2|t2)  'n(b°  *  771  (v  *  w3) 


vi*6' 


'ry 


P2/2j  +  03bQP3  +  82bip3  *  6 
as  K  -*■  00  ,  for  n  even. 


lM] 

(B-15) 


where 


(m  -  1) : 


q  = 


n  +  l 


for  n  even 


(B-16) 


The  procedure  for  n  odd  is  exactly  as  above,  except  that  ^(x)  and  f(x)  must  he 
expanded  to  one  higher  order  than  in  (B- 10)  and  ( B- 1 2).  All  other  symbols  are  as 
defined  above,  except  that  now 


B-4 
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q  = 


for  n  odd  . 


(B-17) 


There  follows  for  (B-5), 


I 


♦S  r<q>  r 

W)’  P 


+  8ib  p? 

1  o  3 


P3P2) 


+  (263bop3  +  B2bl)(p4  ' 


34bQP^  +  3-bj^p2  +  ^2b2P3 


as  N  +  “  ,  for  n  odd. 

(B-18) 


The  desired  asymptotic  expansion  of  integral  (B-5)  is  given  by  (B-15)  and  (B-18) 
for  large  N,  where  N  need  not  be  an  integer.  In  deriving  (B-7)  and  (B-8)  earlier,  we 
only  used  the  dominant  or  leading  term  of  (B-15)  and  (B-18).  Extension  of  (B-7)  and 
(B-8)  to  the  next  term  would  require  consideration  of  the  correction  terms  in  (B-15) 
and  (B-18). 

For  n  =  0,  the  leading  term  of  (B-15)  reduces  to  reference  7,  pages  211-212,  eq. 
5.6.21.  Thus  we  have  generalized  here  to  nonzero  n,  both  even  and  odd,  and  to  the 
first  correction  term. 


B-5/B-6 
Reverse  Blank 
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Appendix  C 

Modified  Approximations  For  Average  Value 

The  approximation  A,  developed  for  the  average  of  the  MC  estimate  in  (45)  tends 
to  infinity  as  C-*0.  That  is,  the  b(C)  term,  (43),  which  is  used  in  approximation  (33), 
blows  up  at  C  =0.  In  order  to  rectify  this  situation,  we  reconsider  the  coefficients 

(1  -  C)2  u  (1  -  C)2(l  +  2C  +  SC2) 
a  2  *  8C  '  (C-l) 

Both  a  and  b  have  the  common  factor  (1-C)-;  this  was  also  true  for  the  MSC  results 
in  (40).  Keeping  this  factor,  we  rewrite  b  in  (C-l )  as 

(1  -  c)2  [q  -  C)2  »  4C(1  ♦  C)] 

°  ~  8C 

(1  -  C)4  (1  -  C)2(l  +  C) 

=  - §C -  +  - 2 -  •  (C-2) 

The  lead  term  in  (C-2)  has  a  fourth-order  zero  at  C  =  1,  and  a  smaller  scale  factor; 
therefore  its  neglect  would  not  significantly  affect  the  value  of  (C-2)  for  moderate 
C.  Also  this  term  contains  all  of  the  singularity  at  C  =  0.  Moreover,  since  (45)  is  an 
approximation  to  an  asymptotic  expansion  which  is  not  uniform  with  respect  to  C,  a 
reasonable  modification  to  (C-2)  is  to  drop  the  singularity  while  trying  to  realize  as 
little  effect  on  larger  C  values  as  possible.  Accordingly  we  adopt  modified  coef¬ 
ficient 

r  _  (1  -  C)2(l  +  C) 

k  "l  >  _ _  . 


thereby  realizing  the  modified  approximation  to  (45)  for  the  MC  estimate, 

a. -,o2(i ,  oV'2  _ 

2  \  2N  2N2  )  (C-4) 

This  result  agrees  precisely  to  0(N~2)  with  reference  4,  eqs.  (39)  and  (33),  when  the 
latter  are  expanded  in  a  power  series  in  N- 1 ;  observe  that  D  =  0(N  2)  there. 

Notice  that  we  have  modified  the  approximation  (45),  but  not  the  asymptotic- 
expansion  (44);  we  must  accept  the  asymptotic  expansion  as  it  is,  since  it  is  the 
unique  expansion  in  powers  of  N'1  for  this  problem.  But  we  can  do  what  we  please 
with  an  approximation. 

For  the  arc  tanh  (x  ;)  transformation,  coefficients  a  and  b  are  given  by  (48)  as 


a 


h  G  -  C2)(l  ♦  2C  -  C2) 
8C 


(C-5) 


C-l 
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We  regroup  the  terms  in  b  (keeping  the  common  factor  1-C2  present  in  both  terms) 
so  as  to  minimize  the  effect  for  larger  C: 

b  =  -  gC-C"  [(1  -  C)2  +  2C(2  -  C)] 

-  (1  tSlil  -  c)3  +  G  -  C2)(2  -  C)  (C-6) 

8C  4 

The  modified  coefficient  is  obtained  by  dropping  the  singular  term: 

h  -  G  -  C2)(2  -  C) 

4  •  (C-7) 


The  modified  approximation  for  the  average  value  is  then 

1  -  C2  G  -  C2)  (2  -  C)\.1/2 


A  =  arc  tanh  C  + 


2  N 


4N 


1 


(C-8) 


This  is  an  extension  of  reference  5,  eqs.  (7)  and  (8). 

For  the  v-th  law  device  considered  in  (58),  the  coefficients  are  repeated  from  (60): 

a  =  v(l  -  C)2  ,  b  =  V(-X-  7cC)  £(i  _  V)  *  2(1  -  v)C  ♦  (1  +  3v)C2J  . 

(C-9) 


Again,  regrouping  the  terms  in  b,  and  keeping  the  common  factor  ( 1  -C)2,  we  obtain 

2  T 

b  =  V(1  ~CC)  [(1  -  V) (1  -  C)2  +  4C(1  -  v  ♦  vC)] 

=  V(1  -  ^211  -  -ci  +  2v( I  -  c)2  (1  -  v  ♦  VC)  ,  (C-10) 

where  the  singular  factor  has  the  fourth-power  of  (1-C).  The  modified  coefficient 
follows  as 


b  =  2v( 1  -  C)2  (1  -  v  >  uC) 


(C-ll) 


(This  reduces  to  (C-3)  for  v-  For  v=  1,  the  lead  term  in  (C-10)  is  already  zero, 
and  (C-10)  equals  (40).)  The  modified  approximation  for  the  average  value  of  the 
output  of  the  v-th  law  device  is 


.(c 


y(i  -  cy 

N 


2v(l  -  C)  (1 


v  + 


vClJ 


An  approximation  to  the  bias  is  afforded  by  subtracting  C1'  from  (C-12). 


(C-12) 


C-2 
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Appendix  D 


Statistics  of  Logarithmic  Transformation 


Average  Value 

According  to  (5),  the  average  value  of  the  output  of  the  logarithmic  trans¬ 
formation  is  given  by 


dx  p(x)  In  x 


(D-l) 


Instead  of  using  (4)  for  the  probability  density,  we  use  reference  1 ,  eq.  (3): 

*-/„l 


dx  (N  -  1)(1  -  C)N  (1  -  X)N'2  F(N,  N;  1;  Cx)  In  x 


n 


=  (N  -  1) (1  -  C)N  £ 


N  *  (N)k  C  f 1 


kto  (15k  (1)k  ^0 


dx(l  -  x)N  2  x  ^  In  x 
(D-2) 


We  now  use  reference  12,  eq.  4.253  1,  to  get,  after  simplification, 

,k 


n  "  W  c 

A  =  -d  -  C)N  T  - [tj»(k  +  N)  -  t|/(k  ♦  1)] 

k=0  K- 


Then  we  employ  reference  8,  eqs.  6.3.6,  15.1.1,  and  15.3.3  to  develop 

N  £  Wk  ^  r2 

a  =  -d  -  cr  £ — vr~  £ 


k=0 


3=0 


k  +  1  +  j 


(D-3) 


»  (N),  C*  N-2  ,  1  .  . 

-  -(>  -OnE  -It-  E  J 

j=0  0 


k=0 


k! 


(D-4) 


with  the  latter  step  taken  to  realize  a  product  of  k  and  j  dependence.  Interchanging 
summation  and  integration,  and  performing  the  sums  (reference  8.  eq.  15.1.8),  we 
obtain 

N-l 


=  -d  -  C)N/ 


dx  (1  -  Cx) 


-N  1  -  x 


1 


(D-5) 


Now  let 


y  = 


1  -  x 


,  X  =  -T— ^ ,  dx  * 

1  +  y  ’ 


d  ♦  y) 


7  »  C1  =  1  -  c  *  (D-6) 


to  get 


D-l 
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00 

i  L  dy 


o 

N-2 


,  -  ,N-1  N-l 

(i  +  y)  -  y 

(1  ♦  Cxy)N 


N-2  /..  a  /■  00  J 

-Cl  L  h  )  f  dy  — ^-N 

1  j=0  V  J  /  J0  (1  + 


-C?  E  N-l  j_!( 
1  jTcA  J  /  rJ  + 


N-l\  j ! (N  -  2  -  j )  ! 


,N-l-j 

1 


Cj  (N  -  1)! 


j=0 


N  -  1  -  j 


N’1  Ci  N=1  l  k 

-  £  x  -  -£  f  <>  -  «k  ; 


”k  ~  "2^  k 
k=l  K  k=l 


(D-7) 


we  employed  reference  12,  eq.  3.194  3,  to  evaluate  the  integral.  Thus  the  difficult 
integral  in  (D-2)  involving  powers,  a  logarithm,  and  a  hypergeometric  function 
becomes  a  very  simple  polynominal  in  1-C. 


If  we  express  (D-7)  for  C>0  as 


& 


(L,  cin  ^  (l_-_cLn  .  ln  c  +  E U^cil 


n=N 


n=N 


we  can  upper-bound  the  bias  (remainder)  in  (D-8)  according  to 


£  ci  -  c^.  <  IL--..C)!!.  n  + 

n-M  11  _  N  L 

n=N 


(1  -  C)  +  (1  -  C)2  +  (1  -  C)3  + 


d-O  =  exp (N  ln(l  -  C))  >  „ 

NC  NC 


(D-8) 


(D-9) 


Since  OO,  the  logarithm  in  (D-9)  is  negative,  leading  to  exponential  decay  of  the 
bias  with  N. 


Mean  Square  Value 

To  determine  the  variance  of  the  logarithmic  output,  we  need  to  evaluate,  in 
addition  to  (D-I),  the  mean  square  value  (61 ): 


(D-10) 


The  expression  for  (D-10)  is  the  obvious  modification  of  (D-2)  obtained  by 
replacing  In  x  by  (In  x)2.  Then  using  reference  12,  eq.  4.261  17,  we  get  (using 
C,  =  l-C) 

00  (N),  Ck  (  2  ) 

Q  =  C,  £  Yi'V  {  [K»(k  +  N)  -  tKk  ♦  D]  ♦  *'(k  ♦  1)  -  >|/(k  +  N)  S 

1  k=0  UJk  (  ) 

(D-l  1) 


D-2 
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Now  use  reference  8,  eqs.  6.3.6  and  6.4.6,  to  find 


(N) k  C 


Q  =  C,  Y.  — nr 
k=0  UJk 


'N-2 


N-2 

♦  £ 


j  =0  (k  4.  1  +  j)2 


(D- 12) 


At  this  point,  we  have  been  unable  to  sum  this  expression  in  closed  form  for 
general  N.  However,  defining 


L  =  -ln(l  -  C)  =  £  i  Cn  , 
n=l 


(D-l  3) 


we  find  that  we  can  evaluate  the  following  cases  in  closed  form  for  any  C: 
Q  =  cj  ^  2  for  N  =  2  , 


q  =  c; 


1  3 

C  +  1  -  C 


K1  -  h) 


for  N  =  3  , 


2  6  6 

2  +  1  -  C  + 

C  L  (1  -  C) 


L  /,  i  2 

2  +  c(  -  C  +  c2 


for  N  =  4  , 


Q  = 


12 


3  1  6  25  20  20 

C+2+3  +  l-C+  2+  3 

C  C  A  C  Cl  -  C)  (1  -  C) 


+  for  N  =  5 


(D-l  4) 


Apparently  the  general  solution  to  (D-l  2)  is  of  the  form 


N-2 

'a  b 

_  N-2  d 

n  n 

+  i  V 

n  „  „  „  n 

C  n 

n=l 

Lcn  (i  -  c)  J 

n=0  C 

(D-15) 

However  we  have  not  been  able  to  determine  the  general  dependence  of  the  coef¬ 
ficients  {an},  { bn } ,  and  {dn}  on  N;  they  are  independent  of  C,  of  course. 

The  mean  square  value,  Q,  for  C  =  0  and  general  N  follows  immediately  from 
(D-12): 

/n-1  A2  N-l 

Q  =  (  £  k  ]  +  £  T  for  C  =  0 

\k=l  k/  k=l  k2  (D'16) 

Combined  with  the  result  for  average  A  in  (D-7),  there  follows  for  the  variance  (65): 


M-i 

V  =  £  -L  for  C  =  0 
k=l  k^ 


(D-17) 


D-3 
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An  asymptotic  expansion  for  (D-17)  for  large  N  is  derived  by  using  Watson’s 
lemma  as  follows: 

V  -  E  1“  *  t  exp(-kt)  -  /•  dt  «  «*<?> 

■n2  .  -Nt  t 

6  “  JQ  6  1  -  exp(-t) 


dt 


e 


-Nt 


as  N  +  “  , 
for  C  =  0  , 


(D- 18) 


where  we  used  reference  12,  eq.  3.411  9.  Thus,  whereas  the  variance  of  the 
logarithmic  device  output  tends  to  zero  as  if  C  >  0  (see  (72)),  the  variance 

saturates  at  rt2/6  if  C  =  0.  Thus  more  pieces  in  the  MSC  estimate  do  not  lead  to 
smaller  variance  for  the  In  x  transformation  when  C  =  0.  To  compensate  for  this 
feature,  we  have  already  observed  in  (58)  that  the  average  output  gets  arbitrarily 
large  as  N  increases,  when  C  =0.  This  behavior  is  due  to  the  singularity  of  the  In  x 
transformation  at  x  =0. 


D-4 
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Appendix  E 

Modified  Forms  For  Variance 


The  asymptotic  expansion  for  the  variance  of  the  MC  estimate  is  given  by  (68). 
We  rewrite  it  as 


V  = 


(1  -  cr 

2N 


(i  -  cr 

8N2  C 


(1  -  C)  +  4C (1  -  3C) 


]  +  o(n"3) 


(E-l) 


As  explained  in  appendix  C,  the  singular  term  has  a  factor  (1-C)4  and  would  not 
overly  affect  the  variance  approximation  for  the  larger  C  values  if  it  were  dropped. 
Thus  we  obtain  the  modified  variance  approximation  for  the  MC  estimate  as 


V  = 


(1  -  cr  (1  -  cr  (1  -  3C) 

2N  '  2N2 


(E-2) 


For  the  arc  tanh  (x '  )  transformation,  we  rewrite  (70)  as 


V  .  4  -  »  -  c>  ■-*  «  °("-3)  . 

/.N  gN^  c 


(E-3) 


from  which  we  immediately  obtain,  upon  dropping  the  singular  term,  the  modifica¬ 
tion 


;  =  ±.  J_ 

-  2N  2N2 


(E-4) 


For  the  v-th  law  device,  we  develop  the  bracketed  term  in  (75)  as 
(1  +  C)2  -  6v(l  +  C)(l  -  C)  +  6v2  (1  -  C)2 

=  (l  -  6v  +  6v2)  (1  -  C)2  +  4C ( 1  -  3v(l  -  C)) 


(E-5) 


Substituting  (E-5)  in  (75)  and  discarding  the  singular  term  (first  term  in  bracket),  we 
obtain  the  modification 


Z  -  2v2(1  -  C)2  C2V_1  4v2(1  -  C)2  C2V_1  (1  -  3v(l  -  C)) 

5  ? 


(E-6) 
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Appendix  F 

Location  of  Peak  of  Probability  Density  Function 


The  probability  density  function  is  given  by  (4).  If  we  use  reference  10,  page  194, 
eq.  8.21.3,  we  find  that 

,  ,  /N.W2  (1  -  C)N  (1  -  X)N~2  I  -^x2 

P(X)~  U  .,1/4  xl/4(l  _^2N-1 


2C 


1  +  (l  -'fid 

.  16(N  -  j)  ^ 


as  N  +  “ 


(F-l ) 


In  so  far  as  locating  the  peak  of  (F-l),  we  need  only  concern  ourselves  with  the 
function 


dN(x)  =  a(x)bN(x) 


"uiW' 

L  N  -  iJ 


(F-2) 


where 

,  ,  _  1  -  •s/Cx*  ,  ,  ,  _  1  -  x  .  (1  -*/Cx)2 

a(x)  =  -jji - =-  ,  b(x)  =  - — j  ,  f(x)  =  - —r2- 

x  7  (1  -  x)  (1  -*fCx)  l&s/cx 


(F-3) 


The  derivative  of  (F-2)  is  (in  shorthand  notation) 

,  '  ',n[\  .  f  1  ,„_N-1  f,  f  "I  f ' 

dw =  a  b  L1  +  irrvi J +  b  L1  +  in-372  J +  ab  nr372 


(F-4) 


Setting  d^  =  0,  we  find  we  must  solve  QN  =0,  where 

Qn  e  N2  ab'  +  N  ja'  b  +  ab'  (f  -  y)j  +  ja'  b^f  -  ~j  +  abf' 

(F-5) 

To  highest  order,  we  must  set  either  a  or  b  '  to  zero.  But  from  (F-3),  a(x)#0  in  (0,  1 ). 
Since 


b'  (x) 


^^7x  -  1 
(1  -*/Cx)3 


(F-6) 


we  see  that  to  highest  order,  the  peak  of  dN  occurs  at 


X1  =  C 


(F-7) 


F-l 
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Now  to  find  the  correction  term  to  x,  of  Q(N  '),  we  let 


x 


+ 


u 

N 


(F-8) 


in  (F-5),  obtaining 


QN~N2(ai +  ^  £)(b;  ♦  b"  |)  ♦  N[(a;  *  a';  £)  (bj  ♦  b; 

+  (ai +  al  £)K  +  bi  w)  (fi +  fi  ^  - §)] +  0(1) 

~N2alb;  ♦  Nja'/jU  +  a// u  ♦  a'^  ♦  (fj  -  -)]  ♦  0(1) 
=  N^h^u  +  a^bjj  +  0(1)  , 


(F-9) 


and  performing  the  last  step  by  use  of  bj'=0.  So,  to  next  highest  order  in  N,  we  have 
the  correction  it  in  (F-8)  as 


albl  =  _  a'(C)  b(C) 
a^b”  a(C)  b”(C) 


(F- 10) 


We  find  from  (F-3), 


a(C)  = 


c1/4(i  -  C) 


,  a(C)  =  - 


1  -  7C 


4C5/4(1  -  C)2 


1  "  -1 
b(C)  =  ,  b  (C)  = 


1  -  C 


2C(1  -  C) 


3  ' 


Substitution  in  (F- 10)  yields 


u  =  -  j(l  -  C)(l  -  70 


(F-l  1) 


(F- 1 2) 


Combining  this  with  (F-8),  we  find  that  the  location  of  the  peak  of  the  probability 
density  function  of  the  MSC  estimate,  £,  is  at 


(1  -  C) (1  -  7C) 
2N 


(F-l  3) 


to  0(N  ').  The  perturbation  (F-12)  has  a  maximum  value  at  C  =  4/7  of  value  9/14; 
thus  the  maximum  movement  of  the  peak  is  9/(14N). 
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